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ABSTRACT 

A "formal information inventory" survey methui was 
used to help educate a unive.rsity campus about outcomes assessment 
while identifying assessment activities already being undertaken. The 
survey was sent to 102 individuals identifiea as being responsible 
for, or having knowledge of, any assessment activities within a 
department or area, w;th 93 responses for a response rate of 91%. The 
survey was designed to be brief, educational for the respondent, and 
effective in collecting information for the outcomes assessment 
coordinator. The survey uncovered 265 assessment activities being 
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units expressed a willingness to participate in a pilot project in 
outcomes assessment. The survey also identified "Student Evaluation 
Studies", "Student Needs Studies", and "Student Evaluation of 
Teaching" as the three types of studies which could most effectively 
be used to make improvements to the programs or services of the 
respondents. One major area of concern was the relative lack of 
cognitive measures; efforts should be continued to develop nd 
provide these outcome assessments as well. The value of this approach 
lies in the educational aspect of the instrument, the construction of 
an institutional statement regarding outcomes assessment, the 
project's high level of visibility, and the involvement of high level 
administrators. Contains 7 references. (GLR) 
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Abstract 

Thosa ambarklng on davalopmant of an aasassmant program ara 
encouragad to Identify aaaaaamant actlvltlaa alraady baing 
undartakan. Although thia la axcallant advlca, It la not aa 
almpla aa It aounda, particularly on lar^ar campuaaa, and tha 
mathod of Identifying currant aaaaaamant Inltlatlvaa la uaually 
not addraaaad. Thia papar prasanta a mathod wharaby a almpla 
aurvay waa uaad to halp aducata tha campua about outcomaa 
aaaaaamant whila Identifying aaaaeament actlvltlaa alraady being 
undertaken. The reeulta of the eurvey are diacuaaed although the 
focua la on the proceaa, content, and application of the aurvay. 
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Introduction 

Institutions confronted with initiating a comprahonsiva 
aaaaaamant program ara of tan ovannhalnad by auch a aaamingly 
monumantal taak. Advica found in tha litaratura on outcomaa 
aaaaaamant, whila wall intantionad, may ba incomplata or 
inapplicabla dua to tha uniquanaaa of aach inatitution'a 
oparation, atudant maka up, and miaaion. A commonly racommandad 
atarting point, applicable to r»at inatitutiona, ia to identify 
assassment activitiaa whicn ara already taking place on tho 
campus and to build on those activitiaa (Aatin, 1987; Ewell, 
1987; Ewell, 1988; Ewell I Liaenaky, 1988; Jacobi at. a1., 1987; 
and Nichola, 1989). Although thia advica ia obvioualy aound, it 
is not as aimpla as it appaara and few of the authora give a 
clear indication of how such activitiaa ahould be identified 
although Ewell (1983, 1988) is probably the moat comprehenaive 
and practical. 

Ewell and Liaenaky (1988, p. 54) auggeat the uaa of a 
**forma1 information inventory** as a aimpla method of determining 
what outcomea data are already in exiatance and include examplee 
of inventor iea which have been previojaly uaad. Inventoriee euch 
aa theee ara uaeful but require aoma prior knowledge of exiating 
information. Rather than downplay the utility of euch an 
inventory, a useful approach would ba to conduct a aurvey auch aa 
the one advocated in thia paper and uaa the information obtained 
from the aurvey to complete a formal inventory. 
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Purpose 

Jhm purpose of this paper la to daacrlba tha procadura uaad 
to Idantify aaaaasmant actlvltlaa on a campua of ovar 14,000 
atudantr whila at tha aama tima aducatlna aagmanta of tha campua 
about outcofnas aaaaasmant and Identifying thosa campua unlta who 
would ba Intaraatad in participating in a pilot aaaaaamant 
projact. 

Hathodology 

Tha first stap in this projact waa to davalop an 
inatitutional atatament regarding outcomaa aaaaaamant. 
Preliminary efforta to develop an inatitutional statement 
included reviewing the university mission statement, diacuaaing 
objactivea with the outcomea asaeaament taak force, reviewing the 
laat accreditation aelf-atudy report, and holding diacuaaiona 
with varioua campus leadere. It waa important that tha 
inatitutional atatament on outcomea aaaaaamant reflect the 
philoaophy of tha coordinator of outcomaa aaaaaamant and at tha 
same time meet with the approval of an outcomea aaaaaament taak 
force which had been previoualy appointed by the Academic Vice 
Preaidant. Tha etatament, which waa accepted and approved, 
apecified two purpoaea for inatituting outcomes aaaaaament on our 
campua : 

(1) to improv) student learning and performance, and 

(2) to improve programa, program planning, and program 
development. 
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Jhm •tat' ant of purpoaa was writtan Into a ona paga 
documant which polntad out tha Imparfact natura of outcofnaa data, 
Icitroducad tha naw coordinator of outcomaa aaaaaamant, and 
Qutllnad tha approach which would ba takan In aatabllahing a 
coord Inatad program of outcomaa aaaaaamanv. Tha Idaa of 
Imparfact data waa Introducad at thia point to avoid what Ewall 
(1988, p. 20) calla tha "parfact data fallacy". Tha raaulting 
ona paga documant waa than uaad aa a covar paga to Introduca tha 
inatrumant. 

Tha aurvay waa daalgnad to ba briaf , to aducata tha 
raapondant, and to coll act Information for tha outcomaa 
aaaaaamant coorJInator. Tha aducatlonal aapact of tha Inatrumant 
wap particularly Important ainca moat paopla tand to focua only 
on taating whan tha tarm "aaaaaamant" la mantlonad. To anhanca 
tha aducatlonal purpoaa, a llat of aaaaaamant actlvltlaa waa 
provldad along with an option to add additional actlvltlaa to tha 
llat. Saa Tabia 1. 

No attampt waa mada to furthar daflna tha actlvltlaa 
although many of tham wara vary almllar. Tha purpoaa of thia 
Itam waa to Idantify actlvltlaa othar than taating that ara part 
of aaaaaamant, and to datarmlna which actlvltlaa. Including 
taating, ara currantly baing undartakan. 
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List of AMMSIMnt ActlvltiM 



If Information from any thraa of tha following aaaasamant 
actlvltlaa could ba provldad to you for tha purpoaa of Improving 
programa or aarvicaa for which you ara raaponaibla, which 
activitiaa would you choosa? (Plaaaa chooaa only thraa) 



a. 


Student Satisfaction Study 


n. 


Job Placement Study 


b. 


Student Attitude Study 


o. 


Employer Satisfaction Study 


c. 


Student Perception Study 


p. 


Alumni Activity Study 


d. 


Student Need Study 


q. 


Transfer Tracking Study 


e. 


Faculty Need Study 


r . 


Program Accreditation Study 


f . 


Faculty Perception Study 


8. 


Diagnostic Placsmsnt 








Testing 


9- 


Faculty Satisfaction Study 


t. 


General Education Testing 


h. 


Student Evaluation of Teaching 


U. 


Major Field Testing 


i. 


Service Evaluation Study 


V. 


Program Admission Testing 


J. 


Program Evaluation Study 


w. 


Pre-11 censing Testing 


k. 


Withdrawing Student Study 


X. 


Certification Testing 


1. 


Program Attrition Study 


y. 


Minimum Competency Testing 


m. 


"High Risk" Student Study 


z. 


Other (Please Specify) 



Once the instrument was developed, the coordinator scheduled 



time on the agenda of the Outromes Asssssment Task Force, the 
Deans Council, made up of the deans from all colleges, and the 
Deans Advisory Council, made up of all the Associate Deans. A 
short prssentation about outcomee assessment was made at sach of 
these meetings and the 1 net rumen t wae distributed for discussion. 
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This procMS, although time consuming and oftan frustrating, was 
usad to aducata, to add to tha vlalblllty of tha coordinator 
poaltlon, and to allcit cooperation and a faallng of Joint 
ownarahip In tha Inatrumant and tha outcomaa aasaasmant program. 
Only aftar thaaa varloua groups ravlawad tha Inatrumant and 
prasontad thair commanta waa tha Inatrumant considered ready for 
uae. 

After examining a current organization chart of the 
unlvaralty, all vice presidents, deana, department hcada, 
directors, provosts, and other professional adminlstratora ware 
aelected to receive the questionnaire. Thie entire population, 
rather than a aample was queried since the size was manageable, 
and to Increaae vielblllty and enhance participation. 
Adminlstratora were chosen In the belief that the^ would have 
mora knowledge of actlvltlee taking place within the units for 
which they were reeponelble. 

A cover letter waa developed and algned by the Academic Vice 
Prealdant, the Chief Executive Officer, giving the project the 
high level of vielblllty suggested by eeveral authors (Ewall, 
1988; Nichole, 1989; Roeeman t El-Khawaa, 198T). The cover 
letter waa dealgned to be educational Inasmuch aa It talked about 
the taak force, the new poeltlon of coordinator, and It aakad 
that the statement on outcomee aaaessment be carefully read and 
the aurvey completed. The namae of tha vice preeldenta and deana 
wars uaed In a mall merge, pereonal Izing the lettera. Labele 
were generated for the other reapondanta and attached to the top 
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of thm Institutional atatamant paga to Idantify tha Individual 
from whom a raaponaa waa daalrad. 

Although tha Inatrumanta wara Individually labalad with tha 
nama and addraaa of tha paraon from whom a raaponaa waa daalrad, 

packata conalating of tha covar 1 attar, tha atatamant on outcomaa 
aaaaaamant, and tha Inatrumant, wara mallad diractly to tha 
approprlata Vica Praaldanta, Oaana, Diractora, Provoatt, and 
Dapartmant Haada. Thaaa top laval admlnlatrators wara givan 
raaponalblllty for dallvaring tha packata of Information to tha 
daalgnatad Indlvlduala, collacting tha complatad forma, and 
raturning tham to tha coordinator of outcomaa aaaaaamant. This 
mathod waa uaad In an affort to Incraaaa tha raaponaa rata and to 
ra-amphaslza tha high laval of Involvamant In tha procaaa. 

Raaulta 

Tha Inatrumanta wara aant to tha antira population of 
admlnlatratora, both acadamic and non-acadamic, on tha campua. 
Tha population conalatad of 102 Indlvlduala who wara Idantlflad 
aa baing raaponalbia for, or having knowladga of, any aaaaaamant 
actlvltlaa within a dapartmant or araa. A total of 93 raaponaaa 
wara racalvad for a raaponaa rata of 9 IX. Tha titlaa of thoaa 
raaponding to tha aurvay aro llatad In Tabia 2. 
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Tabia 2 
Titlas of Raapondnnts 



TItU N 

Daan 6 

Oiractor 22 

OapartfMnt Haad 49 

Provoat 3 

Othar 13 



Total 93 

Thoaa falling Into tha category of "other** had titlaa of 
aaalatant director, coordinator, apecialiat, or aaaiatant 
provoat. 

Reaponaea ware received from all col lagea within the 
univereity aa wall aa numeroua adminiatrativa units. Table 3 
providee detaila of the varioua groupa within the univereity from 
which returna were receivad. 
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TabU 3 
Respondents by Qroup 
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Collage 



Arta and Sclancaa 27 

Agriculture and Home Economlca 11 

Bualneaa Admin let rat Ion 7 

Education 7 

Engineering 5 

Human and Community Servlcea 12 

Graduate School 1 

Admlnlatratlon 23 

Total 93 



The category of "Administration** contained respondents from 
areas such as admissions, regletrar, financial aid, placement and 
career eervlcee, etc.. 

Item 4 of the eurvey asked the reepondent to chooee three 
types of aeeeeement actlvltlee which provide the type vof 
Information they could uee to improve their programs or services. 
A list of ths actlvltlee chosen and the number chooeing each 
appeare in Table 4. 
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leiU 4 

Cho1c«« of Activity Information 



Cholc* N 

Student Satisfaction Study 29 

Studant Naad Study 20 
Studant Evaluation of Taaching 22 

Job Placamant Study 21 

Program Evaluation Study 17 

Faculty Naad Study IS 

Employer Satlafactlon Study 19 

Alumni Activity Study 15 

Withdrawing Studant Study 12 

Studant Parcaptlon Study 11 

Studant Attitude Study 10 

Program Attrition Study 10 



Faculty Satlafactlon Study 
"High Rlak" Student Study 
M< -or Field Teating 
Service Evaluation Study 
Other (Pleaae Specify) 
Tranafer Tracking Stuc'y 
General Education Teating 
Program Accreditation Study 



Minimum Competency Teating 3 

Program AoNilaalon Teating 2 

Certification Teating 1 

Pre-llcenaing Teating 1 

Total 271 
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In addition to th« abov* cl)o1c«« th«r« w«r« ll which f«11 
Into th« eatagory of "Othar". Raaponaaa claaalflfd aa "Othar" 
ara datallad In Tabia 5. 



Tabia 6 

Cholcaa Catagorlzad aa "Othar* 



Choica 



N 



Standardlzad Studant Opinion Survay 

Emp1oy(»r Sat laf act Ion Survay 

Studant Sat laf action Survay 

Tracking Study Comparing Qoala va. Outcomaa 

Faculty Evaluation of Taaching 

Alumni Satlafactlon Study 

Valua Addad Taating (Faculty Davalopad 

Subjact Taat-Rlsing Junior) 
Cradit Articulation Study 
Impact of Minority Studant Study 
Standardlzad Taat for Mu1t1 Sactlonad Couraaa 
Ravi aw of Cllantala Naada 

Total 



ThT9 ara aavaral Intaraating findlnga ralatad to Tablaa 4 
ar.1 6. Firat, ona of tha thraa moat fraquantly aalactad typaa of 
Information la tha atudant avaluatlon of taaching. Thia la of 
particular Intarart Inaamuch aa tha focua appaara to ba mora on 
avaluating taaching than avaluating laarnlng. Thia la almoat tha 
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r«v«r«« of tho normal focus of outcoMC ••••••mont actlvltlos 

Mhoro tho student 1« nwaturod rath«r than tha profaaaor. 

Sacondt thara la a graat daal of conalatancy In tha top four 
cholcaa of Information with aach of thoaa baing choaan by b«twaan 
21 and 29 of tha raapondanta. Tha Indication la that an outcomaa 
aaaaaavant program would provlda Information maanlngful to tha 
majority of thoaa raaponding by focuaing on a "Studant 
Satlaf action Study". "Studant Naad Study", "Studant Evaluation of 
Taaching", and a "Job Placamont Study". 

Third, only fiva raapondanta choaa ganaral aducatlon taating 
and only ona choaa valua addad taating although thaaa ara two of 
tha moat of tan citad foci of an outcomaa aaaaaamant program. On 
thia campua It would appaar that tha amphaala, from tha vlaw 
point of thaae admlnlatratlva raapondanta, ahould ba on atudant 
naada, atudant aatlafactlon, atudant faadback to Inatructora, and 
job placamant Information. 

Quaatlon 5 of tha aurvay raqulrad tha raepondant4 to rank 
ordar thair prafarancaa for aaaaaamant Imitrumanta. Toa raaulta 
of tha ranking ara datallad In Tabia 6. 
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Tftb1« 6 



nanK orosr ot 


Prafaranca for 


Aaaaaamant 


Tools 






Firat 


Sacond 


Third 


Fourth 


Total 


Qu««t1onna1r« 




26 


18 


4 


90 


Int«rv1«w 


37 


31 


8 


13 


77 


Faculty C)«va1opad Tasta 


9 


13 


34 


24 


80 


Standard Izad Taata 


4 


19 


21 


30 


74 


Othar 


2 


1 


1 


4 


8 



Th«r« ar« two Interesting aspocte of these results. First, 
quest lonnalrss and Intsrvlews are by far the most preferred means 
of collecting assessment Information, according to the 
administrators on this campus. 



Second, only 4 Individuals chose standardized tests as their 
firet choice In providing fe^^dback which could be used to improve 
programs or services deeplte their wideepread use. 

In question 7 of the eurvey the reepondente were aeked to 
rank order the frequency of uee of the types of Inetrumente 
actually being used to collect asseeement Information In 
activities which they listed as having been conducted In question 
6. The roeults are compiled and preeented In Table 7. 
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TabU 7 

Rank Ordar of Fraquancy of Uaa of Aaaaaamant Tool a 





First 




Thi rd 


Fourth 

f WVI 1 Wl 1 


Total 


Questionnaire 


48 


10 


4 


0 


62 


Interview 


8 


20 


7 


3 


38 


Faculty Developed Teste 


8 


7 


8 


4 


23 


Standardized Tests 


3 


4 


5 


4 


18 


Other 


3 


8 


2 


1 


12 



The Instrument being used most frequently to collect 
information is the questionnaire. Again, the standardized test 
was used least frequently ae a data collection instrument. It is 
worth noting that the interview was rated first in terms of 
preference by 37 of those responding but it was ranksd as being 
used first most frequently by only 8 respondente. 

In question 8, one of the more critical queetions from a 
practical view point, respondente were asked whether they would 
be willing to participate in a pilot outcomes aeseesment project. 
The results ars lieted in Table 8. 

Table 8 

Intereet in Participating in a Pilot Project 



Choice N 

Not Now 8 

Perhaps Later 30 

Intereeted in Participating 49 



Total 87 
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It was gratifying to find that 56X of tha raaponaaa wara In 
tha afflrmatlva, Indicating a wllllngnaaa to bocoma Involvad In a 
pilot projact. It la particularly Important on our campua ainca 
voluntary participation In pilot projacta la conaldarad tha 
daalrad way to mova forward with an outcomaa aaaaaamant program. 

Tha laat quaatlon aakad If tha raapondant would Ilka 
additional Information about outcomaa aaaaaamant. Thia quaatlon 
waa Includad to provlda anothar opportunity to maka contact and 
diacuaa tha poaltlva banaflta of an outcomaa aaaaaamant program. 
Tha raaulte ara diaplayad In Tabia 9. 

Tabia 9 
Intaraat In Mora Information 

Choica N 

Not Now 3 
Parhapa Latar 11 
Would Lika Mora Information 75 

Total 89 

Aa ona chargad with Implamanting and coordlnntlng an 
outcomaa asaaaamant program, I waa gratlflad to nota that 84X of 
tha raapondanta Indlcacad an Intaraat In obtaining mora 
Information about outcomaa aaaaaamant. 

Impllcatlona 

Aa a raault of tha aurvay 265 aaaaaamant actlvltlaa wara 
Idantlflad which wara currantly baing conducted or had baan 
conductad racantly. In addition, 49 campua unlta axpraaaad a 

ERJC 18 
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w1111ngn«M to partlclpat* In • pilot project In outcoiMs 
assossiMnt. Tho survoy also Idantlflod '*8tud«nt Satisfaction 
Studios'* • '*8tudant Noods Studios**, and '*8tudont Evaluation of 
Tsachlng"* as ths thrso typos of studios which could most 
sffsctlvoly bo usod to mako Improvomonts to tho programs or 
ssrvlcsd of tho rospondants. 

Tho coordinator of outcomss assossmont found only ono major 
aroa of conco rn which surfacod In ths rssults. As was polntod 
out sarllsr, thsro Is a discropancy botwoon tho typos of 
Information doslrsd on this campus and tho typos of Information 
normally consldorod as part of outcomos assossmont. 
Spocif Ically, ths rospondsnts gavo thoir lowost rankings to all 
of tho cognltivs moasuros llstod. Tho samo problom holds truo 
for tho assossmont actlvltlos which woro Idontlflod as boing 
conductsd or having boon conductod rocontly; thoro woro almost no 
cognltlvo assossmont actlvltlos llstsd. Ths Implications of this 
finding should not bo undorstatod. It Indlcatos that whilo tho 
non-cognltlvo aroas ssom to bo woll covorod, soms msthod must bo 
dovlsod to account for tho cognltlvo assossmont nocossary for a 
comprohonslvs assossmsnt program. Thoso who rospondod must bo 
oncouragod to contlnuo thoir of forts and to sxpand thoso of forts 
to provldo Indication of cognltlvo outcomos as woll. Sinco 
cognltlvo outcomos ars much moro difficult, moro oxponsivs, and 
attsmpts to moasurs thom moot with moro roslstancs, ths task Is 
no minor undo r taking. 
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Although this finding Indicates a waaknaaa In tha axlating 
aaaaaamant afforta. It waa not unaxpactad. i4oat Inatltutlona, 
particularly tha largar, raaaarch orlantad Inatltutlona, oparata 
on tha aaaumptlon that tha cognltlva davalopmant of atudanta who 
auccaaafully complata programa la a givan. Tha cognltlva aapact 
of aaaaaamant Is accountad for by tha normal and of couraa 
tasting and tha granting of dagraaa for auccaaaful complatlon of 
praacrlbad couraaa. It la axpactad that anyona attempting to 
bagin a comprahanalva aasaasmant program undar similar condltlona 
would hava similar findings. 

On a mora poaltlva nota, tha aurvay and tha mathoda uaad 
provldad visibility for tha outcomas aaaassmant Inltlatlvaa and 
Incraaaad tha awaranass of admin latratora and othara acroas 
campua about tha outcomaa aaaaaamant movamant. Aa a direct 
raault, numarous Invltatlona hava baan axtandad to tha 
coordinator to maka praaantatlona about outcomaa aaaaaamant. 
Moat of thaaa praaantatlona hava baan followad by Invltatlona to 
maat mora Informally to datarmlna tha baat couraa of action 
within a dapartmant or admlnlatratlva offlca. Tha moat racant 
Invitation cama from tha Collaga of Arta and Sclancaa, tha 
largaat collage on our campua, to maka a praaantatlon to all Arta 
and Sclanca faculty during a racant profaaalonal davalopmant day. 
Thaaa praaantatlona and Informal maal'lnga provlda an opportunity 
to diacuaa tha nacaaalty of adding a cognltlva dimanalon to tha 
aaaaaamant actlvltlas alraady baing undartakan. 
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Although thm study produced quantitative results which ars 
ralsvant to this Institution, ths rsal valus of the approach lias 
In tha educational aapect of the Inatrumsnt, the conat ruction of 
an Inetltutlonal atatement regarding outcomaa aeaeeament, the 
high level of visibility given the project, and the Involvement 
of high levol administrators In the data collection process. The 
results alao provide a direction for the next step In beginning 
our assessment program. The spontaneous requests for 
presentatlona and additional Information provide an open door and 
a point of continuing contact with these admlnletratora. And, 
when an approach Is mads to those Individuals who rsspcnded to 
the survey. It Is possible to know In advance those who are 
likely to be receptive to assessment Initiatives. 
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